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ABSTRACT 


Usability is the pinnacle of interface design with the manifestation of need-based Website Interface as its key 
component in E-government Websites. This paper evaluated the select E-government Websites in India through a 


comprehensive content analysis using heuristic evaluation to determine the nature of distribution of the ordinal 


population of variables that may complement and contribute to a pleasurable user experience. 


Research Aim 


An Expert-based Heuristic Evaluation perspective was proposed to evaluate Homepage considered as a prerequisite 
for the survival of E-government Websites. Through the constituent dimensions namely Online Services, User Help 
and Feedback, Navigation, Legitimacy, Information Architecture and Accessibility Accommodation, an attempt was 


made to principally demonstrate the implementation status of Usability in these Websites in India. 
Theoretical Framework 


Evaluation of E-government Website Usability primarily considered noticeable aspects of the ordinal structure of 
Usability dimensions germane to E-government Websites. The validated theoretical framework enhanced by Baker 


(2004) asserted the demand side strategic considerations in E-government development in India. 
Methodological Framework 


An Explanatory Research Design rigorously investigated the Homepage Usability of E-government Websites by 
logically interconnecting various methods and procedures. The Conceptual/Thematic Content Analysis of a well- 
formulated set of ordinal Usability heuristics evaluated E-government Websites and presented with intensity of 
variables along a continuum across six dimensions. A Usability Measurement Tool comprising 14 Usability 
heuristics with 56 scale measures was developed and applied to a cluster of 17 E-government Websites in India for 


examining the implementation status of its Usability. 
Research Prerogative 


The available literature cites poor Usability as one of the critical factors for continued failure of E-government 
services in developing countries. Hence, an Expert-based Heuristic Evaluation of Homepage becomes paramount to 


address the significant gap in E-government systems besieged by several Usability problems. 
Research Implications 


The prologue to select Usability heuristics for assessment of the nature of ordinality of variables on Homepage of 
select E-government Websites provide an analytical framework for addressing high Usability standards for users to 


maximize benefits from E-government Websites. The findings of this study have a potential significance that may aid 
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1. INTRODUCTION 


User inconvenience with the ease of finding information ascribes the information seeking behavior in E-government 
Websites (Anderson, 2002) that leads to the other digital divide (Stowers, 2002). The resultant Usability barrier, thus, 
creates a gap between those having adequate knowledge of government and technology skills to access government 
websites and those having a deficient understanding about government and derisory technology expertise to access the 
same. Hence, both the digital user and E-government Websites’ Usability signify the structural apparatus of the 
Information Society wherein the user interface complements the provision of multi-optional access to Information 
resources to meet the information needs of users. Consequently, an investigation into E-government Websites’ capabilities 
become paramount in making it easier to use E-government websites for the stipulation of seamless access by Indian 


citizenry. 


Based on the National e-Governance Service Delivery Assessment Framework (2019) conducted on the four 
parameters namely Accessibility, Content Availability, Ease of Use and Information Security and Privacy in select E- 
government Portals of Central Ministries, the following reveals notable aspects of the action plan for key assessment 


parameters: 


e Provision of Accessibility through the availability of bilingual content, listing of contact information of 
government officials/agency providing online services, a separate 'Contact Us' page, an A to Z index as navigation 


routes, and downloadable forms. 


e Content Availability via user feedback/comments, a separate section for help and Frequently Asked Questions 


(FAQs), availability of Sitemap, and information on last updated time-stamp. 


e ase of Use in terms of provision of downloadable application forms, availability of online services within 2- 


clicks from Homepage, provision of a 'What's New’ feature, and search feature. 


e Information Security and Privacy reflected through the visible security policy of the Government, and Clear 


indication of W3C Compliance of the webpage on the Homepage 


Moreover, the E-government progress recognizes the efforts taken by the country to attain the 100" position up 
from 96 in 2018 (UN Survey, 2020) that depict the influence of digital technologies on India’s advancement in E- 
government development. Contextually, user engagement with E-government Websites enfolds a well-organized 
information structure with adequate navigation cues to facilitate access and use of online services with self-help 
instructions and protection of personal information for endorsing Information Needs as asserted by Patterson and Ellis 


(2004). 
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2. THEORETICAL FRAMEWORK FOR E-GOVERNMENT WEBSITE USABILITY 


This paper situates the Six Dimensional Usability as a frame of reference for the research problem and suitable analysis of 
data for accomplishing consequential and generalizable outcomes. Consequently appropriated are the strategic 
considerations that determine and comprehend the following Usability determinants germane to E-government Websites 
that become an imperative critical research area for addressing the probabilistic causal relation between Usability and 


continued failure of E-government initiatives in developing countries: 
2.1 Online Service 


Baker (2009) defines Online Service as a task that users can complete electronically via an E-government Website 24/7 
using the internet. Therefore, the availability of the type and number of services premeditate both the content and 
information value for user-task completion in E-government Websites (ibid). This signifies the decisive role of the overall 
user experience in the diffusion of E-government with user-centric services. Various factors such as multilingualism 
(Bouaziz & Fakhfakh, 2007), locally relevant content in native (Parasuraman et al., 2005; Kim et al., 2006), online demos 
and trials along with voice aid (Sarkar & Cybulski, 2004), opinion poll system, message board and social media platform 
(Cox & Dale, 2001; Liu & Arnett, 2000; Yang et al., 2005), authentic and updated content, availability of comprehensive 
contact information (Email, postal address and/or the telephone/fax numbers) (UNESCO, 2005), and scannable text 


(Nielsen, 1999) considerably maximize user engagement. 
2.2 User Help and Feedback 


Provision of adequate helpful information in E-Government Website helps novice users’ engagement with the timely 
access to government information and services. As E-government Websites contain enormous data, a manifest online help 
function on all web pages (Huang & Benyoucef, 2014) and the search functionality with helpful clues that support user 
searches (Venkatesh et al., 2014) determines a usable and accessible E-government Website. In addition, the provision of 
Frequently Asked Questions (FAQs) assist users in expedient retrieval of vital information (Koyani, 2001) while contact 
details of the officials and support staff help in handling queries with minimum response time (Kim & Stoel, 2004; 
Zeithaml et al., 2000). The availability of the above said trounces any discomfort prompted among users to resolve issues 


encountered while maneuvering these websites. 
2.3 Navigation 


The Information Foraging (Pirolli & Card, 1999) developed as cognitive models of Web navigation predicts Website 
Usability through perceptual cues that users associate with links from one web page to another (Pirolli, 2003) to 
comprehend the information value of the content. Hence, the creation of good links and navigation mechanisms provide 
users with their location on a web page (Mandel, 1997; Baker, 2009; Bishop, Shuman & Vodnik, 2015; Nielsen & Pernice, 
2010) as quicker routes to access the required services (Stowers, 2002). Contrarily, inadequate consideration of Navigation 


in the website design process challenges the survival of E-government websites (Zhao & Benyoucef, 2014). 
2.4 Legitimacy 


In accordance with Stowers (2002), the Legitimacy characteristics reassure users of the E-government Websites with 
security and authenticity in service access. Besides, several features endow with credible evidence and legitimize an E- 


Government Website as an official venue for seeking service from a particular governmental entity. These include well- 
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worded disclaimers, privacy policies, terms and conditions, and copyright information (Asiimwe & Lim, 2010). 
Additionally, the site address or the URL is considered an equally significant aspect related to the credibility of E- 
government website (UNESCO, 2005). Contact details increase the legitimacy of the information that the website contains 


(Nielsen & Tahir, 2002). 
2.5 Information Architecture 


The availability and accessibility of information fabricates a citadel of sophisticated comprehension among users through 
the Information Architecture (IA) of E-government Websites. The IA defines the relationship between a website’s content 
and its functionality (Cardello, 2014) and encourages ease of use that significantly influences E-government adoption. 
Through the effective design, the ease of understanding the system often provides psycho-pleasure to users by ambiguity 
resolution, attitude formation, agenda setting, expansion of belief system, and value clarification in quickly finding the 
information restricted onto web pages to resolve equivocality in E-government Websites (Ball-Rokeach & DeFleur, 1989). 
Moreover, the IA often provides users with nonspecific stratagem such as querying/searching and navigation/browsing 
(Jul & Furnas, 1997). The former assists users in obtaining pertinent information through a search engine while the latter 


involves orderly movement around the Web environment for users to determine their actions. 
2.6 Accessibility Accommodation 


Specifically vital in the domain of E-government Website Usability, Accessibility is defined as the access to information 
and functionality (Olalere & Lazar, 2011; Reis, Barroso, and Goncalves, 2013; Shi, 2007) for users with cognitive or 
functional limitations (Javahery, Gower, Sinnig & Forbrig, 2011) through the use of assistive technologies (Desikan & 
Ramesh, 2006; Ellcessor, 2016; Jordan, Buranapunsri & Berge, 2006; Stephanidis, 2009) and step-by-step guidance 
(Roach & Cayer, 2010) that facilitates quick navigation through online services and help users overcome problems 
encountered with E-government Websites (Baker, 2009). Besides, Accessibility radically contributes to user satisfaction in 
E-government Websites by allowing ease of use and navigability (Pina, Torres, & Royo, 2010) characterized by searchable 
databases, and user-friendly layout. This may augment the process-based trust through more frequent usage (Tolbert & 


Mossberger, 2006). 
3. OBJECTIVES OF THE STUDY 


In order to constructs Usability as a decisive factor for the continued failure rates of E-government initiatives in developing 


countries, the prime objective of this paper is: 


e To identify variations in Homepage manifestation of desirable features based on specific Usability 
Heuristics recognized in the Six Dimensional Usability Framework for indicating efforts in alleviating 


Usability barriers in select E-government Websites. 
4. LITERATURE REVIEW 


Both the digital user needs and the interactive Website design imply a high benefaction by potential users towards the 
adoption of E-government Websites. Considering this, several researchers have examined Usability issues that plague the 
adoption of E-government systems, which consequently results in the failure of E-government initiatives especially in 


developing countries: 
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To deem the “other digital divide”, the research by Stowers (2002) has significantly contributed to propounding 
the elements of excellence in E-government Website Usability. The gap was recognized between those who have 
knowledge about government to obtain immediate gratification through a poorly designed government website and those 
who have less technology expertise to familiarize themselves with the E-government Websites. This divide yielded the 
Six-Dimensional Usability through a content analysis of 148 federal websites to facilitate E-government development. The 
Six elementary Usability features were identified for designing easier to use websites to bridge ‘the other divide’ and 
remove Usability barriers. The content analysis of E-government Website Usability recorded data dichotomously based on 
the presence or absence of particular Usability variables and the evaluated websites were rated based on an additive index 


of variables. 


Furthermore, Baker (2004, 2007, 2009) meta-analyzed six studies using triangulation method to review each of 
the Usability dimensions proposed by Stowers (2002) and a coding scheme was developed for an aggregate measurement 
of discrete variables of manifest content. The proposed methodology demonstrated the efforts taken to encourage Usability 
and goes beyond the mainstream E-government Website Usability research methodology in terms of scale construction to 


represent robustness in the qualitative assessment of usefulness of individual Website Usability attributes. 


Yahya and Razali (2015) proposed a Usability-based framework for Electronic Government Systems 
Development that acts as a guideline for government agencies to consider the contributing factors. The authors also defined 
Usability attributes into six categories namely efficiency, effectiveness, learnability, security, accessibility and usefulness 


that can be measured during the development process for ensuring the Usability of E-Government systems. 


While analyzing the Usability and Accessibility Model for E-Government Websites in Ethiopia, Zeleke (2018) 
confirmed many usability and accessibility gaps due to underperformance of Usability features of Heuristics rules with 
non-conformance with W3C, WCAG 2.1 accessibility guidelines. Consideration of users' requirements; improvement in 
websites’ design, functionality, language and services capability; comprehensive websites' content and documentations; 
augmentation of the capacity and awareness levels of management and employees for the planned implementation of E- 


government website development and assessment activities were suggested. 
5. RESEARCH METHODOLOGY 


An Explanatory Research Design was adopted for a rigorous Usability assessment of 17 E-government Websites using a 
Usability Measurement Tool (UMT) comprising 14 scale variables with 56 Guttmann scale measures (‘0’ for absence and 
‘4’ for robust manifestation) was developed for examining the intensity of desirable features along a continuum that may 


enhance E-government Websites’ Usability (Table 1). 


Table 1: Guttmann Scale Variables of E-government Websites’ Usability 





























Usability Dimension Scale Variables Scale Measure 
Online Services 3 12 
User Help and Feedback 2 8 
Navigation 2 8 
Legitimacy 3 12 
Information Architecture 2 8 
Accessibility Accommodation 2 8 
Total 14 56 
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Six Usability Dimensions with the representation of a set of discrete variables were developed as the mutually 
exclusive and exhaustive content categories (Chadwick et al., 1984) in the select E-government Websites. The Homepage 
was assessed with up to the third click for the ordinal distribution of scale variables to explore the manifest content by 


establishing coding rules to logically categorize each variable for its explicit appearance in each E-government Website. 
6. DATA ANALYSIS 


The obtained data was analyzed using inferential statistical procedures for each of the Six Usability Dimensions with its 
discrete scale variable set in the select E-government Websites. The Mean Scores were computed for each scale variable 
using Guttman scale rating that facilitated the computation of the overall Usability Score for each sampled website. Table 2 
and Table 3 reveal the results of analysis of paired median differences in Scale Variables using a Related Samples- 
Wilcoxon Signed-Ranks Test that statistically inferred the ordinality within and between each Usability dimension for its 
Homepage manifestation in select E-government Websites. 
Table 2: Showing Results of Wilcoxon Signed Ranked Test for Median Differences Within Scale Variables of 
Usability Dimensions 


Wilcoxon Signed Rank Test Within Scale Variables 








Scale Variables Negative | Mean of Positive | Mean Sum of Ties Z Exact 
Ranks Rank Ranks Rank Ranks value Sig. 





Online Service 
Communication 
with Officials- 
Downloadable 
Forms 
Communication 
with Officials- 
Employment 
Information 
Downloadable 
Forms- 
Employment 
Information 
User Help and Feedback 
Search 
Functionality- 
Foreign Language 
Access 
Navigation 

Link to Other 
Agencies- 12 8.08 97.00 2 4.00 8.00 3 -2.857° | 0.003 
Broken Links 
Legitimacy 

Privacy Policy- 
Website Security 
Privacy Policy- 
Date of Last Update 
Website Security- 
Date of Last Update 
Information Architecture 
Audience Focused- 
Personalized/Custo 0 0.00 0.00 12 6.50 78.00 5 -3.126° | 0.000 
mizable 





14 8.57 120.00 3 7.50 33.00 0 -2.113° | 0.030 





7 9.86 69.00 8 6.38 51.00 2 -0.526" | 0.642 





3 7.50 22.50 10 6.85 68.50 4 -1.670° | 0.098 








15 8.77 131.50 1 4.50 4.50 1 -3.380° | 0.000 














6 7.58 45.50 6 5.42 32.50 J -0.528° | 0.635 





9 5.00 45.00 1 10.00 10.00 7 -1.852° | 0.063 





8 7.81 62.50 6 7.08 42.50 3 -0.639° | 0.566 
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Accessibility Accommodation 

Functional 

Accessibility- 0 0.00 0.00 15 8.00 120.00 2 -3.542° | 0.000 
Website Readability 






































The statistically significant Usability Heuristics are observed for ordinality within Usability dimensions that 
indicate the robust manifestation of Communication with Officials in ‘Online Service’ dimension, Search Functionality in 
‘User Help and Feedback’ dimension, Link to Other Agencies in ‘Navigation’ dimension, Personalized/Customizable 
features in ‘Information Architecture’ dimension and Website Readability in ‘Accessibility Accommodation’ dimension. 


Table 3: Showing Results of Wilcoxon Signed Ranked Test for Median Differences Between Scale Variables of 
Usability Dimensions 





Wilcoxon Signed Rank Test Between Usability Dimensions 
Scale Variables Negative | Mean | Sumof | Positive | Mean | Sumof | Tie Z Exact 
Ranks | Rank | Ranks Ranks | Rank | Ranks s_| value | Sig. 








Online Service 


Online Service- User . 
Help and Feedback 10 8.45 84.50 6 8.58 51.50 1 0.867" 


ee 6 9.83 | 59.00 ir 8.55 | 94.00 | 0 
Navigation 


Online Service- - 

Leviinaey 0 0.00 0.00 16 8.50 136.00 1 3.533¢ 

Online Service- 

Information 6 6.92 41.50 10 9.45 94.50 1 ‘i 0.168 
: 1.411° 

Architecture 

Online Service- 

Accessibility 12 9.42 113.00 4 5.75 23.00 1 

Accommodation 

User Help and Feedback 


User Help and - 
Feedback- Navigation 4 7.86 33.50 11 8.38 86.50 2 1.526¢ 


User Help and 

Feedback Legitimacy 0 0.00 0.00 17 9.00 153.00 0 
User Help and 
Feedback- Information 3 5.83 17.50 12 8.54 102.50 2 
Architecture 
User Help and 
Feedback- - 
Accessibility 9 6.22 56.00 2 5.00 10.00 6 2.178 
Accommodation 
Navigation 
Navigation- - 
Lepitimacy 0 0.00 0.00 16 8.50 136.00 1 3.541¢ 
Navigation- 
Information 4 5.50 22.00 6 5.50 33.00 7 
Architecture 
Navigation- 
Accessibility 14 9.79 137.00 3 5.33 16.00 0 
Accommodation 
Legitimacy 
Legitimacy- 
Information 15 8.00 120.00 0 0.00 0.00 2 
Architecture 
Legitimacy- 
Accessibility 





0.416 





0.846¢ 0.409 





0.000 








2.379» | 9.018 





0.139 





3,646¢ | 9-000 





2.452 | 9.015 





0.046 








0.000 





0.574¢ | 0-611 





2.g9sb | 9.003 








3,455» | 9-000 





17 9.00 153.00 0 0.00 0.00 0 0.000 


3.637° 
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Accommodation 
Information Architecture 
Information 
Architecture- 
Accessibility 
Accommodation 
Statistically significant median differences are observed for robust manifestation between ratings of the 








15 8.90 133.50 1 2.50 2.50 1 0.000 


3.428° 






































dimensions ‘Legitimacy’, ‘Accessibility Accommodation’, ‘Information Architecture’ and ‘Navigation’ than dimensions 


“Online Service’ and ‘User Help and Feedback’ on Homepage of sampled E-government Websites. 
8. DISCUSSION 


The present study investigated the E-government efforts in India by evaluating the nature of ordinal distribution of 14 
desirable elements for Homepage manifestation in select E-government Websites in India. The study assessed Usability 
standards for dimensions such as Online Service, User Help and Feedback, Navigation, Legitimacy, Information 
Architecture and Accessibility Accommodation across 17 E-government Websites of the Executive Branch of the Indian 
Government using an Expert-based Heuristic Evaluation. One of the noteworthy findings included the inadequacy in the 
probabilistic manifestation for dimensions namely ‘Online Service’ and ‘User Help and Feedback’ across websites. Hence, 
the distribution of each ordinal variable for its Homepage manifestation across Six Usability Dimensions necessitate 


designing usable websites for important elements in future. 
9. CONCLUSIONS 


The present study investigated the status of Homepage Usability of select E-government Websites in India for addressing 
the Low Usability Index as the foremost indicator of failure of E-government initiatives in developing countries. 
Homepage Usability analyzed for the ordinal distribution of desirable Usability heuristics revealed a consideration of user- 
centricity for information capacities in these Websites. Hence, web developers and government agencies may augment 
Content Usability of these Websites in future by utilizing the outcome of the presented dimensional schema of desirable 


features that construct E-government Website Usability. 
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